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ABSTRACT . 

This study was designed to er^mine the feasibility of 
using simulation as a means of teaching vocational- technical students 
to detect and identify malfunctions in selected electrical and 
mechanical systems. A dynamic simulator was employed which features 
interchangeable panels and logic that permits the simulation of 
electrical or mechanical systems in automobiles, heating and air 
conditioning systems, and various appliances. The study involved 205 
automotive mechanics enrollees at four Pennsylvania area 
vocational- technical schools. The treatment group received 
individual, self-paced instruction on the simulator and performed 
signix xcantly better than the non- treatment group which did not 
receive any simulator instruction. Affective, cognitive, and 
experience type variables were predictive of troubleshooting 
efficiency, while cognitive and experience variables predicted 
success in troubleshooting proficiency. Instructors felt that the 
simulators motivated students, facilitated instruction,, and enhanced 
learning. (Author/GEB) 
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SUMMARY 



TROUBLESHOOTING INSTRUCTION IN VOCATIONAL-TECHNICAL 
EDUCATION VIA DYNAMIC SIMULATION 

This study was designed to examine the feasibility of using 
simulation as a means of teaching vocational- technical students to 
detect and identify malfunctions in selected electrical and mechanical 
systems. The dynamic simulator which was employed features inter- 
changeable panels and logic that permits the simulation of electrical 
and/or mechanical systems in automobiles, heating and air conditioning 
systems, and various appliances. Numerous problems may bn easily 
inserted in each panel and the student may "troubleshoot” each system 
by pressing buttons at various locations on the panel. The simulator 
provides immediate feedback for each check which the student performs . 

A basic question which this study posed centered around the 
utility of simulation. That is, (1) Can troubleshooting skills 
actually be taught via dynamic simulation? Additional questions asked 
which have relevance to the teaching of troubleshooting skills include. 
(2) How do teachers perceive the effectiveness of troubleshooting via 
dynamic simulation? (3) What relationships exist between student 
characteristics (i.e. ability, motivation) and the learning of trouble- 
shooting via dynamic simulation? (4) What attitudes do students have 
toward dynamically simulated troubleshooting instruction? 

Students involved in the study included 205 automotive mechanics 
enrollees at four Pennsylvania area vocational-technical schools. After 
premeasures were administered, students were randomly assigned to treat- 
»nt and non-treatment groups at each of the four locations . Those in 
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the treatment group received individual, self-paced instruction on the 
simulator. The non-treatment group did not receive any simulator instruction. 

Students from both groups were evaluated on their ability to find 
troubles placed in actual equipment. Performance criteria included trouble- 
shooting efficiency, proficiency, redundancy, information checks made, 
action checks made, and time. Treatment group students were tested as 
soon as practicable after they had completed simulator instruction. Non- 
treatment group students were randomly paired with students who had com- 
pleted the instruction and were tested the same day. Experimental data 
were analyzed using the multiple linear regression approach. In this 
man ner the effects of certain variables could fca partialed out so that 
simulator effectiveness could be more accurately assessed. 

With other independent variables held constant, the treatment gr ouj 
performed significantly better than the non-treatment group on four of 
the six criterion measures. The simulator appeared to be an effective 
means of teaching troubleshooting, particularly with regard to problem 
solving strategy development. 

A number of student characteristics variables were significantly 
related to perf o nuance. Affective, cognitive, and experience type vari- 
ables were predictive of troubleshooting efficiency while cognitive and 
experience variables predicted success in information checks performance 
and troubleshooting proficiency. Instructors were generally pleased with 
the simulator as a teaching device. They particularly felt that it 
motivated students, facilitated instruction, and enhanced the learning 
process. 

Students reacted to the instructional sequence in a positive manner. 
Their composite attitude toward simulator instruction was comparable to 
attitude toward traditional classroom or shop instruction. 
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I 

One of the most difficult tasks which faces an instructor is that 
of teaching a student how to solve problems « A primary reason for instruc- 
tional difficulty stems from the fact that problem solving requires an 
individual to perform at a rather high and complex level. As indicated 
by Gagne (1965) 9 when a person solves a problem he combines "principles 
he has already learned into a great variety of novel higher order 
principles • 11 

Xn order to teach problem solving in a meaningful manner, provision 
is often made within a course for the inclusion of practical problem 
solying, experiences • . For example, mathematics instructors might provide 
students with problems to solve which make direct application of s the 
principles taught in class. In science courses, students may use lab- 
oratory facilities to solve problems related to classroom instruction. 

Xn fact, problem solving experiences can be meaningful to students 
irregardless of the course one happens to be enrolled in. As indi- 
cated by Bruner (1970) : 

Good problems, it turns out on closer inspection, are 
the chief vehicle for good curricula whether one is in an 
ordinary classroom or alone in a cubicle with a teaching 
machine • 

Xt is within the area of vocational-technical education that applied 
problem solving instruction is of utmost importance. A number of 
occupations require that workers be proficient diagnostic problem solvers 
or troubleshooters (U.S. Department of Labor, 1965). Students who aspire 
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to these occupations should, therefore, receive experiences which 
assist them in the development of troubleshooting proficiency. 

Ironically, many vocational-technical teachers are not in a favor- 
able position to teach diagnostic problem solving. Although numerous 
instructional areas rely upon "outside" work to provide students with 
realistic experiences, customers may hesitate to bring in repair work 
which involves troubleshooting because they may want a particular 
automobile or television set repaired in a minimum amount of time. In 
view of the fact that a school shop or laboratory accepts projects 
primarily for instructional purposes, it may be several days or even 

weeks before a particular Item Is repaired. 

An additional instructional problem facing teachers involves the 
placement of troubles in otherwise operational equipment. The difficulty 
here lies in the fact that "bugging" tasks usually require an excessive 
amount of instructor time. Also, the instructor may only be able to put 
a few of the many possible troubles into equipment, either because he 
does not have sufficient supply of faulty parts or because the particular 
equipment does not lend itself to trouble insertion* 

A number of investigations has indicated that simulators can pro- 
vide troubleshooting instruction which is at least equal to that afforded 
by actual equipment (Standlee, et al. 1956; Trafton, 1962). There are, 
however, several shortcomings relative to these investigations. First, 
many of the studies examined special purpose simulators which were 
oriented toward the solving of specific problems in specific pieces of 
equipment. The simulators, therefore, were not of a type which allow 
use in several Vocational-technical instructional areas. Second, the 
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subjects utilized in these studies were, for the most part, military 
rather than civilian students. Consequently, research results may have 
limited generalizability to vocational-technical high school enrollees , 
particularly to those students who are culturally and academically cis^ 
advantaged. 

A final point should be made regarding research in public vocational- 
technical education which focuses on simulation. Studies dealing with 
this topic have been, for the most part, concerned with cognitive or 
verbal skill development (Xmpellitteri and Finch, 1971). Ultimately, 
however, vocational objectives are directed toward the application of 
these skills (and others) in a realistic setting. Not only must the 
student learn a principle but he should be able to transfer this prin- 
ciple to situations similar to those he will encounter in the work 
environment. The worth of simulation then lies in the extent to which 
it can provide acceptable transfer to realistic (work environment type) 
tasks. Unfortunately, few of the studies conducted in public vocational- 
technical education have even approached this standard. 

Objectives 

The primary objective of this project was to examine the feasibility 
of teaching troubleshooting in vocational— technical education using the 
dynamic simulation approach. Emphasis was placed on teaching disadvan- 
taged youngsters at the secondary level. More specifically the inves- 
tigation sought answers to the following questions: 

1. What is the general effectiveness of dynamic simulation 
in teaching troubleshooting? 

2. What relationships exist between student characteristics 
and the learning of troubleshooting via dynamic simulation? 
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3. What attitudes do students have toward dynamically 
simulated troubleshooting instruction? 

A. How do teachers perceive the effectiveness of trouble- 
shooting instruction via dynamic simulation? 

General Strategy 

In order to maximize returns on the research investment, several 
administrative arrangements had to be made. First it was decided that 
the study be conducted as a cooperative effort between the Pennsylvania 
Department c£ Eduction, The Pennsylvania State University and several 
area vocational- technical school districts. In this manner, all cooperat- 
ing units could provide input to the research staff as the project pro- 
gressed. Additionally, each unit would be responsible for that aspect 
of the project which it could handle most efficiently. Subsequently, 
secondary area vocational— technical schools in four Pennsylvania school 
districts were identified as having programs that were compatible with 
the project f s outcomes. 

A second general concern was with ownership and maintenance of the 
simulators. It was decided that each school receive a simulator based 
upon a separate proposal and that receipt of the simulator would be 
contingent upon agreement to cooperate with the research effort. As 
part of this agreement, school personnel had the main responsioility of 
providing students wish troubleshooting learning experiences. The 
research staff identified appropriate learning experiences, specified 
those students who would receive instruction, and examined outcomes of 
the experiences. This arrangement enhanced the project's (internal) 
validity by minimizing the number of confounding variables. 
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Prior to the time that a simulator was installed in a particular 
area vocational-technical school, the director and his staff together 
with the investigator developed a plan for simulator incorporation into 
the instructional environment. The general plan (which is specified in 
a later section) allowed for ma^'mum use with minimum instructor involve- 
ment and made provision for data to fee lathered witn a minimum of effort 
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II 

PROCEDURE 

Any research study is, by necessity, limited n scope* As the 
reader will note in the sections which follow, this particular investi- 
gation is no different. Initially, the design of tie study is detailed. 
This is followed by a general description of the simulator which was 
employed as well as the content to which students were exposed. Follow- 
ing a section devoted to measuring instruments, the sample and specific 
research activities are described in detail « 

Design of the Study 

When research is in its planning stages, one is often confronted 
with the task of controlling certain variables which might confound 
results o This is particularly true in a situation where several instruc- 
tors in several schools are teaching students in different grades who 
have varying personal characteristics o In the above situation, a more 
traditional research design would only be able to account for few of the 

dimensions which might be important. 

In the present study, which was directed toward a multi-school, 
multi-teacher, multi-grade sample, it was decided to employ the statis- 
tical technique of multiple linear regression. By utilizing this 
technique, effects of certain independent variables may be partialed out 
so that the unique contribution which a particular independent variable 
makes to a dependent variable may be ascertained. Variables included 
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in the analysis may be continuous or catigorical, thus taking into 
account characteristics such as group membership (i.e., sophomore, jum^r, 
senior) and school membership. Further information on the specific pro- 
gram used in this study is contained in Hallberg (1969) while general 
descriptions of the multiple linear regression technique are describee 
by Bottenberg and Ward (1963) and Smith (1969) • 

The general model employed was 

Y « a Q + a^x-L + a 2 x 2 + • + e 

where 



Y = 



X 



1 ’ 



The specific 

Y± 



dependent 

V 



a l* a 2 ** 



variable 

,X = independent variables 

.... a n “ partial regression coefficients 



error term 

equations used in this study were 

- a c + a l x l + a 2 x 2 + a 3 x 3 + a 4 x 4 + * * * 0 * * * a 18 x 18 + e 



i ® 1, 6 

where 

*= troubleshooting proficiency 
y 2 « troubleshooting efficiency 
y 3 « troubleshooting redundancy 
y^ « troubleshooting search time 
y 3 w troubleshooting action checks 
y^ at troubleshooting information checks 

and 

« treatment 
X 2 ** school 
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x 3 = grade level 
X4 = verbal ability 

= non-verbal ability 
xg = motivation toward learning 
xy = equipment knowledge 
xg = occupational knowledge 
xg = age in months 

x^q = troubleshooting experience in school 

x^ « troubleshooting experience outside of school 

x 12 “ 3 obs held related to instructional area 

x 13 “ hobbies related to instructional area 

x^4 = living area (employment situation) 

x^5 = father's occupation 

Several other independent variables were available only for che group 
that received simulator instruction. These included 
x^g * attitude toward instruction 

X17 «» time lapse between instruction and performance test 
x^g » time to complete instruction 

The Simulator 

In order to dynamically simulate troubleshooting experiences , the 
System Malfunction Analysis Reinforcement Trainer (SMART) was utilized. 
This particular unit t which has been developed by Educational Computer 
Corporation, features interchangeable panels and loglp that permits the 
simulation of electrical and/or mechanical systems in Automobiles, heat- 
ing and air conditioning systems, and various appliances (see Figure 1 ) . 
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Numerous problems may be easily inserted in each panel and the 
student "troubleshoots" each system by pressing buttons at various 
locations on the panel. The simulator provides immediate feedback for 
each check which the student performs. This feedback can be in the form 
of pictures or words (on slides) and color indications on the various 
buttons. Provision for recording student elapsed time to find each 
trouble as well as checks and repairs/replacements made is also incor- 
porated into the simulator. In addition to its potential as a general 
purpose simulator, the unit has shown utility in teaching troubleshoot- 
ing to disadvantaged adults (Educational Computer Corporation, n.d.). 

Instruction Content 

Although the simulator provided students with feedback as they 
attempted to "find" troubles, it was also felt necessary to assist them 
in the development of appropriate troubleshooting strategies. Con- 
sequently, each student was provided with a Troubleshooting Booklet which 
led him through various representative troubles and provided him with a 
general procedure to follow as he attempted to find each trouble. The 
material, which was developed by Educational Computer Corporation and 
modified for use in this study by the research staff, was programed in a 
linear format. It was written so that instruction could be provided on 
an individual basis and would be self-paced. Examples of booklet content 
are presented in Appendix B. By using the booklet each student was able 
to receive troubleshooting instruction "on his own", however, instructors 
were able to provide assistance in order that each person would be kept 
"on the right track." 
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FIGURE 1 



THE SYSTEM MALFUNCTION ANALYSIS REINFORCEMENT TRAINER (SMART) 
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A troubleshooting Answer Sheet was also developed for use in con 
junction with the Troubleshooting Booklet and simulator (see Appendix B) . 
Its purpose was to gather formative data relative to each student's 
progress on the simulator. At three points In the booklet the student 
was asked to find a different trouble which was placed In the simulator 
system. Each trouble was representative of those which he practiced 
with but was different from any of those in the instructional sequence. 
For each trouble he was asked to record time to solution, as well as the 
number of tests and repairs /replacements made. This answer sheet was 
fashioned after the recording forms ui3ed at The Northeast Pennsylvania 

Technical Center. 

Prior to the time that the booklet was used by students, it was 
reviewed by each of the instructors involved in the experiment. They 
were asked to review the booklet a..J react to it in terms of content, 
sequence, and flow (use in conjunction with the simulator). All 
instructors felt that the material was satisfactory in this regard. 
Several errors were noted and corrected. The booklet in final form then 
consisted of a number of exercises related to trcubles in Engine 
Starting-1 and Engine Starting-2 panels which instructors felt were use- 
ful and representative of troubleshooting instruction that a youngster 

might receive. 

Measuring Instruments 

In order to gather relevant data from students involved in the 
study, a number of measuring instruments were used. Several of these, 
which were standardized measures, are described briefly. Others, that 
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were developed specifically for this study, are explained in greater 
detail. Copies of measures are presented in Appendix A. 

Student Information Sheat 

The Student Information Sheet was designed to gather information 
about student personal background and also to provide some information 
about each individual's "disadvantagedness. " Variables identified with 
this instrument included school course area, teacher, age, sex, year in 
school, amount of troubleshooting experience, full-time jobs, hobbies, 
area where student lived, and several indices of disadvantagadness . 
Transfer of responses to data cards was provided as an integral part of 
information sheet development. The completed instrument was administered 
to twenty— six automotive students enrolled at The Northeast Pennsylvania 
Technical Center. Based upon reactions of these students, several items 
were further refined* 

Automotive Engine Knowledge Examination 

The purpose of the Automotive Engine Knowled^-*. Examination was to 
obtain some index of student background with regard to the specific 
equipment. Based upon the primary systems which comprise the automobile 
engine, a table of specifications was developed. This table Indicated 
the relative weighting of te&t items of the systems and combination of 
systems in the automobile engine. Then, items were either selected from 
existing automobila mechanics examinations or were developed by the 
principal investigator. The preliminary Automobile Engine Knowledge 
Examination (AEK) consisted of 51 multiple choice items. An initial 
administration of the AEK was conducted at the Northeast Pennsylvania 
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Technical Center. Twenty-six automotive mechanics students who were 
participating in a MDTA program at the Center comprised the group taking 
the examination. Data gathered was then, processed by computer. The 
initial analysis resulted in a KR-2D reliability of .82. Results also 
indicated that five items were discriminating negatively. These items 
were discarded from the examination prior to the second administration. 
The second administration with a revised forty-six item test was con- 
ducted at the Altoona Vocational-Technical School. Students taking the 
examination were sophomores, juniors, and seniors enrolled in the Altoona 
automobile mechanics program. A total of sixty— four students were 
involved in this administration. Results of the second administration 
indicated a KR-20 reliability of .73 and KR-21 reliability of .70. All 
of the items discriminated positively. As an addi. ional validity check, 
a comparison was made between the mean scores of the sophomore, junior, 
and senior students. Data for the group was subjected to single classi- 
fication analysis of variance. Results indicated that the AEK discrim- 
inated significantly (p<.01) between students with varying amounts of 
exposure to automotive instruction (senior x> junior x> sophomore x) . 

School Motivation Scale 

Xn order to obtain some measure of student motivation toward 
school work, it was felt necessary to use an instrument which would pro- 
vide valid information. The motivation measure chosen was that 
developed by Russell (1969). It consisted of thirty items which a 
student reacted to by placing an X in either the "yes" or the no 
column. Results reported by Russell indicate that the scale had 
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adequate reliability on several administrations and correlated with 
several indices of achievement. 

Student Reaction Form 

The Student Reaction Form provided students taking simulator 
instruction with a means of reacting freely to their instructional 
experience. It consisted of two questions which were boti\ open-ended . 

The first specified "What did you like best about your instruction on 
the SMART trainer?" while the second question asked "What did you like 
least about your instruction on the SMART trainer?" 

Troubleshooting Performance Test 

This test, which was the dependent variable, evaluated a person’s 
ability to troubleshoot (find troubles in) an automobile engine. For 
detailed information on the general strategy followed when developing 
this performance measure, the paper written by Finch and Impellitteri 
(1970) should be reviewed. A portion of this paper which deals 
specifically with the performance test used in this study is presented 
in the next few paragraphs. 

The troubleshooting performance measure was designed to meet 
several unconventional requirements. First, it should evaluate a 
student's ability to troubleshoot (find troubles in) an automobile engine. 
Second, it should be appropriate for use with the automotive students 
of eight instructors in four Pennsylvania vocational-technical schools. 

In view of the fact that the project was evaluating troubleshooting 
simulator effectiveness, the concept of content validity first came to 
mind. Initial discussions with the eight instructors revealed that the 
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most appropriate index of effectiveness would be transfer to actual 
equipment. All eight persons agreed on this point. The objective then 

specified that 

The student will find two troubles placed one at a time 
in an otherwise operational automobile engine. The basic 
troubleshooting tools provided by the examiner will include 
a screwdriver, spark plug wrench, ignition wrenches, pliers, 
and a test light. There will be no time limit in which to 
find the troubles. 

Since the instructors (who were also tradesmen) agreed that transfer to 
actual equipment was appropriate, it can be assumed that the educational 
validity was established to some degree. As an additional check of 
educational validity, examination was made of the Standards for Automotive 
Service Instruction in Secondary Schools . This publication, which has 
been developed by the Automobile Manufacturers — American Vocational 
Association Industry Planning Council, specifies curriculum standards 
for automotive programs. It was indicated in the publication as one 
automotive curriculum objective "to develop an understanding of logical, 
step-by-step diagnostic procedures" (Standards, 1965, p. 17 ). Based 
upon the foregoing information, educational validity was deemed adequate. 

Although occupational validity was used as a partial basis for 
curriculum inclusion, it was felt that additional information should be 
obtained about the objective. An examination of the Dictionary of 
Occupational Titles (U.S. Department of Labor, 1965) revealed that a 
number of jobs in the automobile service area require a worker to have 
diagnostic capability, particularly with regard to automobile engines. 
Based upon this information, the objective was felt to be occupationally 
valid. 
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There was naturally some concern about face validity (the extent 
to which the instrument looks like it would measure what it intends to 
measure). Since the instrument was not administered by instructors, 
attention was directed toward the examinee. How would he react to the 
test situation? Observation of 45 students under similar conditions in 
a previous study (Finch, 1969b) indicated that students reacted posi- 
tively to the testing environment. It was, therefore, contended that 
face validity might be adequate for purposes of the present study. A 
field trial conducted after the present measure was developed also 
resulted in positive student reactions. It was on the basis of the 
foregoing that face validity was considered to be satisfactory. 

Since the instrument was concerned with physical performance as 
described by Harmon (1969) (perform an appropriate skilled action in a 
problem solving situation) and measurement of verbal or attitudinal 
behaviors were not included, these factors did not need to be taken into 
account within the development scheme. It was then felt that determi- 
nation should be made of whether the objective required task procedure 
and/or task end product measurement. Since the objective specified a 
rather dichotomous situation (either the trouble is found or it is not 
found) a decision was made to record the task procedure. In this 
manner, meaningful information about a student's problem solving 
strategy could be gathered. A product measurement, on the other hand, 
would provide very little information with regard to instructional 

improvement . 

The work performance meaisure required each examinee to locate 
two troubles which were representative of those an auto mechanic or an 
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advanced automotive student might be required to find. One of the 
troubles was in the engine fuel system while the other was in the elec- 
trical system. Materials used in the examination administration con- 
sisted of observer's instructions, student's instruction, and a record 
of troubleshooting behavior. The behavior record was similar in design 
to the type developed by Fattu and Medley (1952) . Its purpose was to 
record a student's sequence of actions as he attempted to find the 
troubles. The instrument was designed so that an examiner could 
accurately record observable behavirrr without even knowing if this 
behavior was correct or incorrect. separate sheet was used to record 
student behavior for each trouble. ) ©rformanct. sub-scores were 
established based upon the analysis of. data frcnn a previous investigation 
(Finch, 1969) and a review of resear.-cLi in the area of problem solving 
performance measuremei. c . 

Since the literature review did not identify any specific standards 
for combining troubleshooting performance sub— scores into a composite 
performance score, and a number of possible scores could be derived, it 
was felt best to examine troubleshooting performance as defined by each 
of the separate sub-scores. These sub-scores or criteria consisted of 
proficiency, efficiency, redundancy, search time, action checks maoc, 
and information checks made. All criteria were developed from data 
recorded on the behavior record. 

Several guidelines were developed for the scoring the troubleshoot- 
ing performance test. These were necessary in order the criteria could 
be interpreted in a meaningful manner. 
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The more proficient troubleshooter was speciried as one who tends 
to find troubles with greater frequency than his less proficient counter- 
part. Proficiency score was determined on the basis of the number of 
troubles found. That is, a person finding both troubles would be more 
proficient than one who found only one trouble or who found no troubles. 

An efficient troubleshooter can be defined as ona that make^ checks 
which optimize isolation and identification of problems. An optimum 
n umb er of twelve information checks was established for each of the 
troubles. This reflected the number of checks needed to identify each 
of the troubles in an efficient manner. The formula used to determine 
efficiency score was: 

E = InfN - .02 'NonlnfN) 

0 

where 

E = efficiency 

InfN ■ number of information checks made 
NonlnfN ** number of non- information checks made 
0 = optimum number of information checks (12) 

.02 m constant 

A less redundant troubleshooter was specified as one who rechecks 
the same places to obtain the same information with less frequency than 
his more redundant counterpart. The formula used to determine redun- 
dant counterpart. The formula used to determine redundancy score was: 



R - 50 - R ed N 

where 

R m redundancy score 
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r u = number of redundancies accumulated 
ed 

50 = constant 
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Search time was defined as the time in seconds that each person 
spent attempting: to reach solution ((find troubles) . This time was mot 
"time to find a trouble" but time spent on a trouble since a number of 
people did not teach solution. 

The Action check score consisted of the total number of different 
points in the system which were visited by an individual. Add.it iona__ly , 
the information check score was comprised of the total number of — n— or— 
mation points visited. An information point may be defined as any 
action point at which information about the system condition is observable 
Each completed behavior record was analyzed to determine the roc 
performance sub— scores for a particular trouble. Ten of the twelve sub 
scores (five fuel problem sub-scores and five ignition problem sub- 
scores excluding the two proficiency scores) were then converted to 
standard scores with a mean of 50 and standard deviation of 10. Common 
sub-scores for each of the two problems were then added together to pro- 
duce combined sub-scores. This procedure is presented graphically in 
Table 1. A combined proficiency sub-score was obtained by allowing three 
points for finding both troubles, two points for finding one trouble 
and one point for finding no troubles. 

Prior to its administration in the research project, an index of 
interobserver reliability for the test was obtained in a field trial 
situation. Nine high school auto mechanics students were asked to find 
a trouble in an otherwise operational automobile engine. The trouble 

was identical to one of those used in the project. A correlation between 

O 

ERJC 



28 



22 



TABLE 1 

PROCEDURE USED TO OBTAIN COMBINED PEFFORMANCE SUB-ECQKIES 



Sub-scores 


Tt: oub les 
T 1 T 2 


Combinec 


S isb-S cores 


Efficiency (E) 


El + E 2 


as 




Redundancy (R) 


Rl + 


= 


Rrn 


Search Time (S) 


Si + s 2 


M 


S 

1 


Action Checks (A) 


A 1 + A 2 


S3 


bej. 


Information Checks (I) 


II + I 2 


SS 


~T 



actual times recorded by observer A and observer B was .997, while the 
correlation for information checks was 1.0. Since the students’ infor- 
mation check scores were converted directly from recorded information, 
it was felt that the correlations obtained were an accurate index of 
inter-observer consistency. 

Instruction Attitude Inventory 

In order that some insight might be gained into student attitude 
toward simulator instruction, an Instruction Attitude Inventory (IAI) 
was completed by each student after he had finished his instructioi; on 
the simulator. Although not developed specifically for this study, the 
IAI displays adequate validity and reliability (Finch, 1969a) and has 
demonstrated its usefulness in a number of research settings. 
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California Test of Mental Maturity 

In order to identify personal characteristics of the students which 
would r r alats to academic disadvantagedness, an ability test battery was 
se-lecned dor use in the study. The most appropriate test battery with 
regard to a mis between amount of pertinent information gathered and 
administration time was the California Test of Mental Maturity (CTMM) . 

The d TMM , 1963 edition, has what appears to be a good data base with 
regard to secondary school youngsters (Clark and Tiegs , 1963) . Level 
four of the CTMM was chosen for administration to the students involved 

in the study. 

Short Occupational Knowledge Test 

It is virtually impossible to obtain comprehensive information 
about a person's occupational knowledge in a short period of time. As 
an alternative to this, it was decided to employ the Short Occupational 
Knowledge Test (Auto Mechanics) which has been developed by Science 
Research Associates (Campbell and Johnson, 1970). This test, which con 
sists of twenty multiple choice items, has an adequate reliability Index 
and has been shown to discriminate between auto mechanics and non-auto 
mechanics with a great deal of precision. 

Instructor Reaction Form 

In order that some idea of the instructors' feelings about the 
simulator might be obtained, an Instructor Reaction Form was developed. 
This instr ume nt consisted of two questions which were both open-ended. 
The first question specified "list three or four things that you like 
best about the simulator" while the second asked each instructor to 
"list three or four things that you like least about: the simulator. 
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questions allowed the instructors to provide free (but subjective) 
eactions about the simulator. The Instructor Reaction Form was used as 
a basis for development of the Simulator Evaluation Questionnaire des- 
cribed below* 

; 2imilator Evaluation Questionnaire 

In order to assess simulator effectiveness from the teacher s 
antage point, it was necessary to develop a data gathering device which 
would be as valid and as objective as possible. It was initially 
decided to use a questionnaire which incorporated the Likert format 
'Likert, 1932). Instructors were asked to react to statements about the 
simulator which they had been using with their classes. Reactions were 
aade by circling the appropriate response on a four point scale ranging 
from strongly agree to strongly disagree. In this manner objectivity 
could be maximized. Statements used in the questionnaire came from two 
sources . First, the investigator developed a listing of statements based 
upon conversations with teachers and school directors. Additional state- 
ments were generated from a free response questionnaire (Instructor 
Reaction Form) which the instructor group had completed earlier in the 
school year. The sixty-one statements included in the Simulator Evalu- 
ation Questionnaire (see Appendix A) then reflected content validity 
from an instructor point of view. That is, questionnaire content should 
represent evaluation areas that instructors feel are important. As 
statements were being developed, some were noted as being positive and 
some "negative". By including both types of statements in the question- 
naire the possibility of response set was minimized. 
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Sample 

Within the research framework it was felt important to identify a 
sample which would be representative of students receiving troubleshoot- 
ing Instruction in vocational-technical education. This concern was 
discussed with several vocational school directors at the project s 
inception and, based upon a general consensus of opinion, it was decided 
to examine simulator effectiveness using a student group in the auto 
mechanics area. An in-depth study of automotive troubleshooting 
instruction via simulation appeared to be feasible since instruction 
in this area is provided in many vocational-technical schools. Addition- 
ally, automotive service involves troubleshooting of electrical and 
electromechanical systems. In effect, the troubleshooting performed 
by automotive service personnel is not unlike that performed by persons 
in other maintenance areas. Systems in the many maintenance areas have 
generally similar characteristics (electrical and electromechanical) , 

They also require a troubleshooter to apply system knowledge and 
strategies in order to identify a malfunction. 

The sample consisted of all sophomore, junior, and senior auto- 
motive students enrolled at Bethlehem, Berks— West, and Centre County 
Vocational Schools as well as all students in The Service Station 
Mechanics program at Johnstown AVTS . Half of the remaining automotive 
students at Johnstown were also included in the sample. 

The initial available sample consisted of all those students 
included above who were available for testing during the fall of 1970. 

The number of students from whom personal data were gathered totaled 251. 
A breakdown of students by school and grade level is presented in Table 2 
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TABLE 2 



DISTRIBUTION OF STUDENTS PROVIDING PERSONAL 
DATA BY SCHOOL AND GRADE LEVEL 



Grade 


A 


School 
B C 


D 


Total 


10 


29 


14 


41 


27 


111 


11 


18 


14 


24 


31 


87 


12 


19 


7 


16 


11 


53 


Total 


66 


35 


81 


69 


251 



The net available sample was composed of Chose students who* In 
addition to providing personal data, completed the Automobile Engine 
Knowledge Examination and the Troubleshooting Performance Test. Of 
this group (n = 205), 105 made up the treatment group while the control 
group numbered one hundred. A distribution of students by school, 
grade, and group is given in Table 3. The lower number of students 
reported in Table 3 can be attributed to several factors. First, some 
students were "lost" because they quit or were dismissed from school. 
Others were not available for performance testing when it was scheduled 
to be administered. A few youngsters were eliminated because of 
improper instructional procedures conducted at one school when the pro- 
ject first began. Last, because of time considerations, instruction 
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TABLE 3 

DISTRIBUTION OF NET AVAILABLE SAMPLE BY 
GROUP, SCHOOL, AND GRADE LEVEL 



Grade 








School 










Total 






A 




B 


c 




D 








TR 


NT 


TR 


NT 


TR 


NT 


TR 


NT 




10 


11 


8 


7 


6 


21 


17 


14 


12 


96 


11 


9 


7 


5 


5 


8 


9 


13 


14 


70 


12 


7 


8 


4 


3 


0 


6 


6 


5 


39 


Total 


27 


23 


16 


14 


29 


32 


33 


31 


205 



TR = Treatment (received simulator instruction) 

NT = Non-Treatment (did not receive simulator instruction) 



and testing v;as terminated in several schools after a sufficient number 
of students had completed these activities. 

In order to present a more comprehensive profile of the students 
which were included in the sample, data for several of the variables 
were compiled. These variables consisted of Language and Non-Language 
scores on the California Test of Mental Maturity (CTMM) as well as 
scores from the Short Occupational Knowledge Test (SOKT) . The data 
are presented in Tables 4 through 6. Mean scores for the CTMM and SOKT 
reflect a general increase across grades with lower mean scores being 
produced by students at the lower grade levels. 
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TABLE 4 



CTMM LANGUAGE MEAN SCORES BY SCHOOL 
AND GRADE LEVEL 



Grade 






School 






A 


B 


C 


D 


10 


24.89 


27.00 


26.37 


27.81 


11 


27.38 


34.40 


30.53 


30.26 


12 


30.00 


30.14 


32.17 


32.27 






TABLE 5 








CTMM 

BY 


NON-LANGUAGE MEAN SCORES 
SCHOOL AND GRADE LEVEL 




Grade 






School 






A 


B 


C 


D 


10 


30.95 


34.38 


36.79 


32.27 


11 


34.25 


37.50 


35.06 


35.26 


12 


37.47 


39.14 


37.17 


38.73 
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TABLE 6 



SHORT OCCUPATIONAL KNOWLEDGE TEST (AUTO MECHANICS) 
MEAN SCORES BY SCHOOL AND GRADE LEVEL 



Grade 






School 






A 


B 


C 


D 


10 


5.00 


6.46 


6.13 


6.46 




11 


9*62 


8.10 


8.65 


9.22 




12 


12.80 


11.29 


10.83 


10.18 





CTMM language mean scores for 10th, 11th, and 12th graders were 
found to be consistently below the norm* Mean scores rur 10th graders 
ranged from the 24th to 34th percentile while mean scores for 11th and 
12th grade students ranged from the 27th to 50th percentile and 27th to 



34th percentile respectively* Non-language mean scores were substan- 
tially higher. Tenth grade students' scores ranged from the 38th to 
66th percentile. Eleventh and 12th grade scores ranged from the 46th 
to 62nd percentile and 58th to 69th percentile respectively* 

Since scores for the SOKT are not intended tc be presented in 
distribution form, some comparisons can be made with the category cut- 
offs provided in the test manual* Tenth and 11th grade mean scores 
fell into the fail category based upon a national sample of auto 
mechanics (score of ten or less). However, one of the 12th grade means 
fell in the pass category (12+) while another fell in the unclassif iable 
category (11). The two other 12th grade group means approached place- 
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Additional descriptive data were available for the student sample. 
This data was drawn from the Student Information Sheet and consisted of 
categorial variables . 

Twenty-one percent of those students involved in the study indicated 
that they lived in a farm area while town and city dwellers numbered 54 
and 25 percent respectively. Sixty percent of the students specified 
that some persons in the area where they lived did not have jobs. "Many 
don’t have jobs" was checked by four percent of the group while 34 per- 
cent indicated "everyone has jobs." No data was available for two 
percent . 

yith regard to students* views of discrimination, eight percent 
felt that they had been discriminated against at some time while sixty- 
six percent did not feel this way. Twenty-six percent of the group did 
not know whether or not thtey had ever beeu discriminated against. 

Data on father’s occupation was compiled as follows: Unskilled = 

4%, Semi-Skilled = 33%, Skilled = 41%, Sales = 3%, Technical - 8%, and 
Professional = 3%, No information = 8%. For the most part, the father's 
occupation reflected employment in a skilled or semi-skilled area. Nine 
percent of the student group indicated that their families had been on 
welfare while 85 percent reacted in a negative manner to this question. 
Welfare data was not available for six percent of the group. 

Research Activities 

The following paragraphs have been Included in order that one 
might become familiarized with specific research procedures. They detail 
critical research activities in a somewhat chronological manner. 
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Early in che .-school ytat* t infoniation was gathered about fcli0 
students constituting the sulected sample. Each student s personal back- 
ground, ability, and motivation were assessed* Instruments used for 
this purpose included the Ca' torn? a Test of Mental Maturity (short form), 
the Short Occupational Knowledge Te?t in Automotive Mechanics, a School 
Motivation Scale, and a Student Information Sheet* Concurrent with the 
gathering of this information, automotive instructors received an 
orientation to the simulator and became thoroughly f amiliarized wich 
its capabilities. This orientation was conducted by the Educational 
Computer Corporation staff. Additionally, simulators were installed in 
each of the four cooperating schools and were checked out to assure 
that they operated properly. 

After these activities had been accomplished, instructional materials 
were then delivered to the eight cooperating teachers. These materials 
included an Automobile Engine Troubleshooting Booklet s"d a booklet 
answer sheet. Instructors were then given sufficient time to review the 
booklet in conjunction with the simulator. It was asked that instru- 
ctors study the booklet the same way that their students would. In this 
manner each instructor would be familiar with the instructional unit and 
would be able to assist students with any problems encountered on the 
booklet or the simulator. 

After the instructors had become familiar with the troubleshooting 
booklet and the panels which were to be used with the booklet, other 
materials were provided to them. These materials included additional 
copies of the Automobile Engine Troubleshooting Booklet as well as 
copies of the Instruction Attitude Inventory, Student Reaction Form, 
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and Troubleshooting Answer Sheet. All materials were provided in 
sufficient numbers so that instructors could use them with designated 
students. Concurrent with this, students were randomly selected by 
school, class, and year in school to either the treatment or control 
group. Additionally, treatment group assignment to instruction was 
randomly made. Instructors were then asked to present all of their 
automotive students, both treatment and control, with an introduction 
to the simulator. They gave a one class period discussion which covered 
the general operation of the simulator, drawing from the information 
in the simulator Operator's Manual. This was a general overview and 
was not intended to include specific troubleshooting instruction. The 
instructors showed how the simulator operated, where the basic switches 
were, and what they did. At the same time, instructors told the 
students that they might get a chance to use the unit sometime during 
the school year. 

In the middle of October, students in the treatment group started 
receiving simulator instruction. Students received instruction one— by— 
one according to the pre-arranged schedule. Each instructor in each 
school gave the designated student a troubleshooting booklet to use and 
told him not to write in the booklet. He was also asked to contact the 
instructor if he had any problems using the booklet or the simulator. 
After each student had completed his instruction on the Engine Starting-1 
panel, he asked the instructor to change the panel. At this time the 
Engine Starting-2 panel, slides and logic were placed on the simulator. 
After the student had completed all instruction, his booklet and answer 
sheet were collected and he was provided with an Instruction Attitude 
O 
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Inventory and a Student Reaction Form to complete. At this time, 
another student from the treatment group was placed on the simulator. 

Approximately three or four weeks after the first student began 
instruction on the simulator, the principal investigator traveled to 
each school to test students in terms of troubleshooting performance 
on actual equipment. Students tested included those who h^d completed 
instruction on the simulator as well as those randomly assigned to the 
control group who were listed '’opposite" completed treatment students. 

The purpose of this evaluation was to measure transfer from simulator 
to actual equipment. In order to accomplish this task, an engine 
mounted on a trailer was utilized. This unit was constructed by 
students at the Centre County Vocational-Technical School under the 
direction of several instructors. Concurrent with performance 
evaluation, students completed the Automobile Engine Knowledge Examin- 
ation. This examination was designed to obtain an up-to-date indication 
of each student's knowledge with regard to the instructional area. 

At regular intervals, the test engine was towed to each of the four 
schools and student troubleshooting ability was assessed. 

Periodically, after a sufficient number of measures had been 
scored, information was placed on data cards. At the conclusion of the 
experiment, final information was key punched and data were processed 
using the 360/67 computer. The multiple linear regression approach was 

utilized to analyze experimental data. 

During the later part of the school year, instructor reaction infor- 
mation was gathered and students’ attitudes toward classroom and shop 
instruction were assessed. These data were later compiled. and examined 
in a descriptive manner « 
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FINDINGS 



There were several questions posed by this research which focused 
on the effectiveness of teaching troubleshooting via dynamic simulation* 
These questions included: What is the general effectiveness of dynamic 

simulation? What relationships exist between student characteristics 
and the learning of troubleshooting via dynamic simulation? What atti- 
tudes do students have toward dynamically simulated troubleshooting 
instruction, and how do teachers perceive the effectiveness of trouble- 
shooting via dynamic simulation? Findings relevant to these questions 
are presented in the following paragraphs • Several of the findings have 
beer; developed from rather complex analyses while others are presented 
in a descriptive manner* 

T he General Effectiveness of Dynamic Simulation 
in Teaching Troubleshooting 

In order to assess the effectiveness of dynamic simulation it was 
necessary to determine what unique relationship the prime independent 
variable, group membership (treatment vs, non-treatment) f might have 
with the six dependent variables (proficiency, efficiency, redundancy, 
search time, action checks, and Information checks). It should first 
be noted that this independent variable was categorical with the group 
receiving simulator Instruction coded 1 and the control or non— treatment 
group coded 0. Additionally, proficiency was coded 1, 2, or 3 depending 
on whether an individual found no troubles, one trouble, or both 
troubles. The other five dependent variables were continuous and, prior 
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to the analysis, had been derived from raw sub-scores which were first 
converted to standard scores and then combined. 

Independent variable means and standard deviations for the treat- 
ment group, non-treatment group, f-t > d total sample are provided in 
Table 7. These include scores on tests and scales which were described 
in a previous section as well as biographical and school membership data. 
Variables three through six were coded one for "yes" and two for no . 
Employment in home area (variable 7) was coded as follows: everyone has 

jobs = 1, some don't have jobs = 2, many don't have jobs = 3. Variable 
eight (father’s occupation) consisted of five categories: unskilled = 1, 

semi-skilled = 2, skilled = 3, technical = 4, professional = 5, School 
membership variables (18, 19, 20, 21) were coded one for "yes" and zero 

for "no". 

Initially, a zero-order correlation matrix was generated for the 
six performance (dependent variables and all independent variables. 

This data is presented in Table 8„ Intercorrelations ranged from .389 
to -.241. A number of these relationships were significant at or beyond 
the .05 level. A comment should be made regarding three of the variables. 
Instruction Attitude Inventory, time lapse, and time to complete instruc- 
tion scores were only available for those persons completing simulator 
instruction. Consequently, the correlations have not been included in 
this particular matrix. They are, however, reported as part of the 
student characteristics analysis which is presented in a later section. 

Multiple linear regression analysis (MRA) was then conducted to 
identify the unique contribution which each of the independent variables 
made to the dependent variables. As indicated previously, prime concern 
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TABLE 7 



MEANS AND STANDARD DEVIATIONS FOR THE 21 INDEPENDENT 
VARIABLES BY TREATMENT GROUP, NON- TREATMENT GROUP, 

AND TOTAL SAMPLE 





Variables 


Treatment 
(n - 105) 


Non-Treatment 
(n = 100) 


Total 
(n « 205) 


X 


SD 


X 


SD 


X 


SD 


1. 


Age in months 


195.02 


12.21 


196.39 


11.37 


195.59 


11.78 


2. 


Grade (10,11,12) 


10.65 


0.73 


10.82 


0,77 


10.73 


0.76 


3. 


School Troubleshooting 
















Experience 


1 .80 


0,40 


1.79 


0.41 


1.80 


0.40 


4. 


Outside of School Trou- 
















bleshooting Experience 


1.73 


0.45 


1.55 


0.50 


1.63 


0.48 


5. 


Jobs in Automotive Area 


1.65 


0.48 


1.71 


0.68 


1.68 


0 . 70 


6. 


Hobbies in Automotive Area 1* 38 


0.49 


1.36 


0.48 


1,37 


0.48 


7. 


Employment in Home Area 


1.61 


0.53 


1.80 


0.57 


1.71 


0.56 


8. 


Father f s Occupation 


2.77 


0.79 


2.77 


0.87 


2.77 


0*82 


9. 


Instruction Attitude 
















Inventory 


174.84 


20.76 


a 


a 


a 


a 


• 

o 

H 


Time Lapse - Instruc- 
















tion and Test (in days) 


22.41 


17.85 


a 


a 


a 


a 


n. 


Time to Complete 
















Instruction (in minutes) 326.03 


110.75 


a 


a 


a 


a 


12. 


School Motivation Scale 


18.21 


3.91 


18.25 


3.83 


18.22 


3.83 


13. 


Occupation Knowledge Test 7.67 


3.96 


8.70 


4.01 


8.09 


3o 99 


14. 


CTMM Language 


29.01 


8.34 


28.64 


8.26 


28.74 


8.30 


15. 


CTMM Non-Language 


35.71 


7.02 


34.99 


7,27 


35.30 


7 o 06 


16. 


Engine Knowledge Test 


23.04 


6.10 


22.87 


6,00 


23.00 


6 • 12 


17. 


Group 


1.00 


0.00 


0.00 


0.00 


0 . 51 


0.50 


18. 


School. A Membership 


0.27 


0.45 


0.23 


0.42 


0.24 


0.43 


19. 


School B Membership 


0.29 


0.46 


0.31 


0.46 


0.31 


0 . 46 


20. 


School C Membership 


0.29 


0.46 


0.32 


0.47 


0.30 


0.46 


21. 


School D Membership 


0.14 


0,35 


0.14 


0.35 


0.15 


0.35 



a Data for variables 10, 11 s and 12 were not available for the non' 
treatment group <> 
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was with the treatment variable as this differentiated between students 
receiving and not receiving simulator instruction. Other independent 
variables were also important to the extent that they made unique con- 
tributions to each of the performance variables. Initially, a full 
model analysis was undertaken to examine the unique Information avail- 
able from each of the 18 independent variables (variables 9, 10, and 11 
were omitted from the analysis) . This was conducted for each of the six 
dependent variables. Full model (and subsequent restricted model) 
analyses were found to have F— ratios significant beyond the .05 level. 

A number of the variables in the full model did not appear to possess 
enough unique information to be statistically significant. Therefore, 
in order to account for all variables and also identify those having the 
most unique and predictively useful information, a restricted MRA model 
was calculated. This was conducted using a step-down process. On the 
basis of the least reduction in sums of squares regression, one indepen- 
dent variable at a time was successively omitted until only those 
variables with significant partial regression coefficients remained. 

The level of significance established was .05. 

Regression analysis between the independent variables and proficiency 
for the restricted model is prov ^ed in Table 9. Using all eighteen 
independent variables In the full model yielded a multiple correlation 
of .5119. The coefficient of determination in the full model adjusted 
for degrees of freedom was equal .1949. The adjusted coefficient of 
determination is arrived at by squaring the multiple correlation and 
then adjusting that figure for the expected shrinkage upon cross 
validation. When the restricted model wa3 calculated and only variables 
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TABLE 9 



REGRESSION ANALYSIS BETWEEN FOUR INDEPENDENT 
VARIABLES AND THE DEPENDENT VARIABLE PROFICIENCY 

(n - 205) 





Variables 


Partial 

Regression 

Coefficient 


Standard 

Error 


Student "t" 


5. 


Jobs in Automotive Area 


-.1872 


.0874 


2.14* 


13. 


Occupation Knowledge Test 


.0267 


.0112 


2.39* 


16. 


Engine Knowledge Test 


.2234 


.0071 


4.08** 


o 

00 

H 


School A Membership 


.9121 


.0936 


2 . 39* 


Intercept 


.9121 


.2410 





Standard Error of Estimate » .5665 
Multiple Correlation (full model) — .5119 

Adjusted Coefficient of Determination (full model) a .1949 
Multiple Correlation (four independent variables) = .4741 

Adjusted Coefficient of Determination (four independent variables) = .2093 



* = P < .05 

** = P < .01 
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with significant partial regression coefficients remained, the multiple 
correlation was .4741 and the adjusted coefficient of determination was 
equal to .2093, This adjusted figure indicated a slight gain in pre- 
cision due to the elimination of less useful variables . In order to 
interpret relationships between the four significant variables and the 
criterion, each partial regression coefficient was examined. In general, 
one unit Increase in any of the independent variables results in a 
change in the dependent variable equal to the size of the partial 
regression coefficient with the other independent variables held con- 
stant. Therefore, a one unit increase in engine knowledge test score 
corresponds with a .2234 increase in proficiency score. A one unit 
decrease in jc' s in automotive area (coded 1 = yes, 2 = no) is associ- 
ated with a .1872 increase in proficiency score. Additionally, member- 
ship in school A reflected an average proficiency score which was 
significantly higher than membership in other schools. 

Table 10 presents the regression analysis between independent 
variables and the dependent variable search time. The adjusted 
coefficient of determination for the full model was .0701 while elim- 
ination of fifteen variables yielded an adjusted coefficient of .0817. 
Variables remaining in the model included age, jobs in automotive area, 
and occupation knowledge and, while this relationship was low it was 
significant. When interpreting this table it should be remembered that 
search time was recorded in seconds. Thus, a higher occupation know- 
ledge test score is associated with a lower search time. Again, 
variable 17 (Group) did not possess a significant partial regression 
coefficient and was eliminated in the step-down process. 
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TABLE 10 



REGRESSION ANALYSIS BETWEEN THREE INDEPENDENT 
VARIABLES AND THE DEPENDENT VARIABLE SEARCH TIME 

(n = 205) 





Variables 


Partial 

Regression 

Coefficient 


Standard 

Error 


Student ,f t n 


1. 


Age 


.2147 


0.973 


2.21* 


5. 


Jobs in Automotive Area 


3.7681 


1.567 


2.41* 


13. 


Occupation Knowledge Test 


-1.0i0 


0.288 


3.51** 


Intercept 


59.959 


18.894 





Standard Error of Estimate — 15.4831 
Multiple Correlation (full model) ** .3842 

Adjusted Coefficient of Determination (full model) = .0701 
Multiple Correlation (three independent variables) = .3086 

Adjusted Coefficient of Determination (three independent variables) = .0817 



* = P < .05 

■rff 3*C P < c 01 
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Regression analysis data for the dependent variable action checks 
is provided in Table 11. The overall adjusted coefficient of determin- 
ation (all independent variables included) was .0011 while the restricted 
coefficient (one variable) increased to .0259. The resultant correlation 
between the remaining independent variable (Group) and the action checks 
criterion was moderate (.1751). The t value was significant beyond the .05 
level. Thus, on the average, treatment group students scored 5.60 units 
higher on the action checks variable than did non-treatment students 
and this was true with the effects of all other independent variables 
held constant. 

t .2 presents the regression analysis between four independent 
variables and the dependent variable information checks. The overall 
adjusted coefficient of determination was .1948 while the restricted 
coefficient increased slightly to .2103. Thus, elimination of less 
useful variables through the stepdown process increased predictive 
efficiency. The multiple correlation was .4751 with four v. /riables 
remaining in the restricted model. Variable 17 (Group) attained the 
highest partial regression coefficient and the highest t_ value (5.02). 

On the average, students in the treatment group scored 10.65 units 
higher on the information checks variable than did the non-treatment 
group. Other variables included in the partial regression model were 
grade, jobs in automotive area, and engine knowledge. The grade 
variable and engine knowledge variable were positively related to 
number of information checks made. Jobs in automotive area was 
negatively related, however, since one was "yes" and two was no , 
results should be interpreted accordingly. Persons who held jobs in 
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